Vehicle and method for controlling the vehicle

ABSTRACT

A vehicle including a plurality of displays disposed at different positions inside the vehicle, each display including a touch screen and a cover layer on a top surface of the touch screen, the cover layer of a corresponding display having a color characteristic based on an interior part of the vehicle having the display such that when the corresponding display is off, the corresponding display appears hidden; a sensor configured to detect a seat location of a person seated in the vehicle; and a controller configured to selectively control the plurality of the displays based on the detect seat location of the person seated in the vehicle.

CROSS REFERENCE TO THE RELATED APPLICATIONS

This application claims the benefit of Korean Patent Application No.10-2015-0153836, filed on Nov. 3,2015, which is hereby incorporated byreference as if fully set forth herein.

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention relates generally to a vehicle and a method forcontrolling the vehicle, and more particularly, to a vehicle equippedwith a display having a predetermined light transmittance, and a methodfor controlling the vehicle.

Discussion of the Related Art

A vehicle refers to a device that carries a passenger or goods from oneplace to another by driving wheels. For example, a two-wheeled vehiclesuch as a motor bike, a four-wheeled vehicle such as a sedan, and atrain are vehicles.

To increase the safety and convenience of vehicle users, technology isunder rapid development to introduce various sensors and electronicdevices into vehicles. Especially, a system that provides a lot offunctions developed to increase the driving convenience of users, suchas smart cruise control and lane maintaining assistance, is installed ina vehicle. Accordingly, autonomous driving is enabled, by which avehicle travels on a road on its own in consideration of itssurroundings without manipulation of a driver.

In this context, demands for a display capable of providing informationrelated to vehicle driving to a user fast and effectively are on theincrease. However, if many displays are provided in a vehicle, a user'svision may be distracted. Moreover, even though a display is turned off,the display and its adjacent area are not visually smooth, which makesit difficult to render the interior to be more sophisticated. Further,there is a need for a technique for displaying information intended byusers including a driver in time.

SUMMARY OF THE INVENTION

Accordingly, the present invention is directed to a vehicle and a methodfor controlling the vehicle that substantially obviate one or moreproblems due to limitations and disadvantages of the related art.

An object of the present invention is to provide a vehicle equipped withat least one display with a cover having a predetermined lighttransmittance, for mitigating a sense of difference between the displayand other interior parts and suppressing distraction of the vision of auser, and a method for controlling the vehicle.

Another object of the present invention is to provide a vehicle forincreasing the use convenience of a user by displaying differentinformation on each display according to the position of each user, atraveling situation of the vehicle, a touch input, or the like, and amethod for controlling the vehicle.

Additional advantages, objects, and features of the invention will beset forth in part in the description which follows and in part willbecome apparent to those having ordinary skill in the art uponexamination of the following or may be learned from practice of theinvention. The objectives and other advantages of the invention may berealized and attained by the structure particularly pointed out in thewritten description and claims hereof as well as the appended drawings.

To achieve the object and other advantages and in accordance with thepurpose of the invention, as embodied and broadly described herein, avehicle includes at least one display disposed inside the vehicle, and acontroller connected to the at least one display, for controlling anoperation of the at least one display. Each of the at least one displayincludes a touch screen, and a cover layer combined on a top surface ofthe touch screen and having a predetermined light transmittance.

Both the foregoing general description and the following detaileddescription of the present invention are exemplary and explanatory andare intended to provide further explanation of the invention as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are included to provide a furtherunderstanding of the invention and are incorporated in and constitute apart of this application, illustrate embodiment(s) of the invention andtogether with the description serve to explain the principle of theinvention. In the drawings:

FIG. 1 is a block diagram of a vehicle according to an embodiment of thepresent invention;

FIG. 2 illustrates the exterior of a four-wheeled vehicle according toan embodiment of the present invention;

FIGS. 3A, 3B, and 3C are views referred illustrating external camerasdepicted with reference to FIG. 1;

FIG. 4 illustrates an example of the vehicle illustrated in FIG. 1;

FIG. 5 is an exemplary interior block diagram of a controllerillustrated in FIG. 1;

FIGS. 6A and 6B are views referred to illustrating an operation of thecontroller illustrated in FIG. 5;

FIG. 7 illustrates an exemplary interior view of a vehicle according toan embodiment of the present invention;

FIG. 8 illustrates an exemplary structure of a hidden display accordingto an embodiment of the present invention;

FIG. 9 illustrates an exemplary user interface for receiving a turn-oncommand and a turn-off command for a plurality of hidden displaysillustrated in FIG. 7;

FIGS. 10A and 10B illustrate an exemplary operation for controlling theplurality of hidden displays illustrated in FIG. 7 in a vehicleaccording to an embodiment of the present invention;

FIGS. 11A and 11B illustrate an exemplary operation for controlling theplurality of hidden displays illustrated in FIG. 7 in a vehicleaccording to an embodiment of the present invention;

FIGS. 12A, 12B, and 12C illustrate various examples of informationdisplayed on a hidden display in a vehicle according to an embodiment ofthe present invention;

FIGS. 13A and 13B illustrate exemplary control of an operation of ahidden display provided on a door in a vehicle according to anembodiment of the present invention;

FIGS. 14A, 14B, and 14C illustrate exemplary control of an operation ofa hidden display provided on a door in a vehicle according to anembodiment of the present invention;

FIGS. 15A and 15B illustrate exemplary control of an operation of ahidden display provided on a door in a vehicle according to anembodiment of the present invention;

FIGS. 16A and 16B illustrate exemplary control of an operation of ahidden display provided on a door in a vehicle according to anembodiment of the present invention;

FIGS. 17A and 17B illustrate an exemplary operation for changinginformation displayed on a hidden display according to identification ofa user in a vehicle according to an embodiment of the present invention;

FIGS. 18A and 18B illustrate an exemplary operation for displaying ascreen of a mobile device located inside a vehicle on a hidden displayin the vehicle according to an embodiment of the present invention;

FIG. 19 illustrates an exemplary operation for displaying an image ofthe surroundings of a vehicle on a hidden display in the vehicleaccording to an embodiment of the present invention;

FIGS. 20A, 20B, and 20C illustrate an exemplary operation for displayingan alarm indicator on a hidden display in a vehicle according to anembodiment of the present invention;

FIGS. 21A and 21B illustrate an exemplary operation for displaying analarm indicator on a hidden display in a vehicle according to anembodiment of the present invention; and

FIG. 22 illustrates an exemplary operation for controlling the screencolor of each of a plurality of hidden displays according to a presetscenario in a vehicle according to an embodiment of the presentinvention.

DETAILED DESCRIPTION OF THE INVENTION

Embodiments disclosed in the present disclosure will be described indetail with reference to the attached drawings. Like reference numeralsdenote the same or similar components throughout the drawings and aredundant description of the same components will be avoided. The termswith which the names of components are suffixed, ‘module’ and ‘unit’ areassigned or interchangeably used with each other, only in considerationof the readiness of specification writing. The terms do not have anydistinguishable meanings or roles. Further, the attached drawings areprovided to help easy understanding of embodiments disclosed in thepresent disclosure, not limiting the scope and spirit of the presentinvention. Thus, the present invention covers all modifications,equivalents, and/or alternatives falling within the scope and spirit ofthe present invention.

While ordinal numbers including ‘first’, ‘second’, etc. may be used todescribe various components, they are not intended to limit thecomponents. These expressions may be used to distinguish one componentfrom another component.

When it is said that a component is ‘coupled with/to’ or ‘connected to’another component, it should be understood that the one component isconnected to the other component directly or through any other componentin between. Further, when it is said that a component is ‘directlyconnected to’ or ‘directly coupled to’ another component, it should beunderstood that there is no other component between the components.

Singular forms include plural referents unless the context clearlydictates otherwise. In the present disclosure, the term ‘have’, ‘mayhave’, ‘include’, or ‘may include’ signifies the presence of a specificfeature, number, operation, component, or part, or their combinations,not excluding the presence or addition of one or more other features,numbers, operations, components, or parts, or their combinations.

In the present disclosure, a vehicle may be any of an internalcombustion vehicle equipped with an engine as a power source, a hybridvehicle equipped with an engine and an electrical motor as powersources, an electric vehicle equipped with an electrical motor as apower source, and the like.

FIG. 1 is a block diagram of a vehicle 100 according to an embodiment ofthe present invention. Referring to FIG. 1, the vehicle 100 may includea communication unit 110, an input unit 120, a memory 130, an outputunit 140, a vehicle driving unit 150, a sensing unit 160, a controller170, an interface unit 180, and a power supply 190.

The communication unit 110 may include one or more modules that enablewireless communication between the vehicle 100 and an external device(for example, a portable terminal, an external server, or anothervehicle). Also, the communication unit 110 may include one or moremodules that connect the vehicle 100 to one or more networks.

The communication unit 110 may include a broadcasting reception module111, a wireless Internet module 112, a short-range communication module113, a location information module 114, and an optical communicationmodule 115.

The broadcasting reception module 111 receives a broadcast signal orbroadcasting information from an external broadcasting management serverthrough a broadcast channel. Herein, broadcasting covers radiobroadcasting or TV broadcasting.

The wireless Internet module 112 refers to a module used for wirelessInternet connectivity, and may reside inside or outside the vehicle 100.The wireless Internet module 112 is configured to transmit and receivewireless signals over a communication network compliant with a wirelessInternet technique.

Wireless Internet techniques include, for example, Wireless Local AreaNetwork (WLAN), Wireless Fidelity (Wi-Fi), Wi-Fi Direct, Digital LivingNetwork Alliance (DLNA), Wireless Broadband (WiBro), WorldInteroperability for Microwave Access (WiMAX), High Speed DownlinkPacket Access (HSDPA), High Speed Uplink Packet Access (HSUPA), LongTerm Evolution (LTE), Long Term Evolution-Advanced (LTE-A), and thelike. The wireless Internet module 112 transmits and receives dataaccording to at least one of wireless Internet techniques that includeother Internet techniques in addition to the above enumerated ones. Forexample, the wireless Internet module 112 may exchange data wirelesslywith an external server. The wireless Internet module 112 may receiveweather information and traffic information (for example, TransportProtocol Expert Group (TPEG) information) from the external server.

The short-range communication module 113 is used for short-rangecommunication. The short-range communication module 113 may supportshort-range communication using at least one of Bluetooth™, RadioFrequency Identification (RFID), Infrared Data Association (IrDA), UltraWideband (UWB), ZigBee, Near Field Communication (NFC), Wi-Fi, Wi-FiDirect, Wireless Universal Serial Bus (Wireless USB).

The short-range communication module 113 may conduct short-rangecommunication between the vehicle 100 and at least one external deviceby establishing a short-range wireless communication network. Forexample, the short-range communication module 113 may exchange datawirelessly with a portable terminal of a passenger. The short-rangecommunication module 113 may receive weather information and trafficinformation (for example, TPEG information) from the portable terminalor the external server. For example, if a user is aboard the vehicle100, a portable terminal of the user and the vehicle 100 may be pairedwith each other automatically or upon execution of an application by theuser.

The location information module 114 is a module configured to determinea location of the vehicle 100. A major example of the locationinformation module 114 is a Global Positioning System (GPS) module. Forexample, the location of the vehicle 100 may be acquired using signalsreceived from GPS satellites at the GPS module.

The optical communication module 115 may include an optical transmitterand an optical receiver. The optical receiver may receive information byconverting an optical signal to an electrical signal. The opticalreceiver may include a Photo Diode (PD) for receiving light. The PD mayconvert light to an electrical signal. For example, the optical receivermay receive information about a preceding vehicle by light emitted froma light source included in the preceding vehicle.

The optical transmitter may include at least one light emitting devicefor converting an electrical signal to an optical signal. The lightemitting device is preferably a Light Emitting Diode (LED). The opticaltransmitter converts an electrical signal to an optical signal andoutputs the optical signal to the outside. For example, the opticaltransmitter may emit an optical signal to the outside by flickering alight emitting device corresponding to a predetermined frequency.According to an embodiment, the optical transmitter may include aplurality of light emitting device arrays. According to an embodiment,the optical transmitter may be integrated with a lamp provided in thevehicle 100. For example, the optical transmitter may be at least one ofa head lamp, a tail lamp, a brake lamp, a turn signal lamp, and aposition lamp. For example, the optical communication module 115 mayexchange data with another vehicle by optical communication.

The input unit 120 may include a driving manipulator 121, a microphone123, and a user input unit 124.

The driving manipulator 121 receives a user input for driving thevehicle 100. The driving manipulator 121 may include a steering inputmechanism, a shift input mechanism, an acceleration input mechanism, anda brake input mechanism.

The steering input mechanism receives a traveling direction input forthe vehicle 100 from the user. The steering input mechanism may includea steering wheel. According to an embodiment, the steering inputmechanism may be configured as a touch screen, a touchpad, or a button.

Further, the shift input mechanism receives a parking (P) input, a drive(D) input, a neutral (N) input, and a reverse (R) input for the vehicle100 from the user. The shift input mechanism is preferably formed into alever. According to an embodiment, the shift input mechanism may beconfigured as a touch screen, a touchpad, or a button.

In addition, the acceleration input mechanism receives an accelerationinput for the vehicle 100 from the user. The brake input mechanismreceives a deceleration input for the vehicle 100 from the user. Theacceleration input mechanism and the brake input mechanism arepreferably formed into pedals. According to an embodiment, theacceleration input mechanism or the brake input mechanism may beconfigured as a touch screen, a touchpad, or a button.

A camera 122 is disposed at a part inside the vehicle 100 and generatesan image of the inside of the vehicle. For example, the camera 122 maybe disposed at various positions of the vehicle 100, for example, on thesurface of a dashboard, on the surface of a roof, or at a rear viewmirror, and capture a passenger in the vehicle 100. In this instance,the camera 122 may generate an inside image of an area including adriver's seat in the vehicle 100.

Also, the camera 122 may generate an inside image of an area includingthe driver's seat and a passenger seat in the vehicle 100. An insideimage generated by the camera 122 may be a two-dimensional (2D) imageand/or a three-dimensional (3D) image. To generate a 3D image, thecamera 122 may include at least one of a stereo camera, a depth camera,and a 3D laser scanner. The camera 122 may provide its generated insideimage to the controller 170 operatively coupled with the camera 122. Thecamera 122 may be referred to as an ‘internal camera’.

The controller 170 can detect various objects by analyzing an insideimage received from the camera 122. For example, the controller 170 candetect the driver's gaze and/or gesture from a part of the inside image,corresponding to an area of the driver's seat. In another example, thecontroller 170 can detect a passenger's gaze and/or gesture from a partof the inside image, corresponding to an area other than the area of thedriver's seat. Obviously, the driver's gaze and/or gesture and thepassenger's gaze and/or gesture may be detected simultaneously.

The microphone 123 may process an external sound signal to electricaldata. The processed data may be used in various manners according to afunction being executed in the vehicle 100. The microphone 123 mayconvert a voice command of a user to electrical data. The convertedelectrical data may be provided to the controller 170. In addition,according to an embodiment, the camera 122 or the microphone 123 may beincluded in the sensing unit 160, instead of the input unit 120.

The user input unit 124 is configured to receive information from theuser. Upon input of information through the user input unit 124, thecontroller 170 can control an operation of the vehicle 100 incorrespondence with the input information. The user input unit 124 mayinclude a touch input mechanism or a mechanical input mechanism.According to an embodiment, the user input unit 124 may be disposed inan area of a steering wheel. In this instance, the driver may manipulatethe user input unit 124 with his or her finger, while grabbing thesteering wheel.

The input unit 120 may include a plurality of buttons or a touch sensorand perform various input operations through the plurality of buttons orthe touch sensor.

The sensing unit 160 senses a signal related to traveling of the vehicle100. For this purpose, the sensing unit 160 may include a collisionsensor, a steering sensor, a speed sensor, an inclination sensor, aweight sensor, a heading sensor, a yaw sensor, a gyro sensor, a positionmodule, a vehicle forwarding/backwarding sensor, a battery sensor, afuel sensor, a tire sensor, a hand rotation-based steering sensor, avehicle internal temperature sensor, a vehicle internal humidity sensor,an ultrasonic sensor, an infrared sensor, a radar, a Light Detection AndRanging (LiDAR), and the like.

Accordingly, the sensing unit 160 may acquire sensing signals forvehicle collision information, vehicle heading information, vehiclelocation information (GPS information), vehicle angle information,vehicle speed information, vehicle acceleration information, vehicleinclination information, vehicle forwarding/backwarding information,battery information, fuel information, tire information, vehicle lampinformation, vehicle internal temperature information, vehicle internalhumidity information, a steering wheel rotation angle, and the like.

Also, the controller 170 can generate a control signal for acceleration,deceleration, direct change, or the like of the vehicle 100 based onambient environment information acquired by at least one of a camera, anultrasonic sensor, an infrared sensor, a radar, and a LiDAR of thevehicle 100. The ambient environment information may be informationrelated to various objects within a predetermined distance range fromthe traveling vehicle 100. For example, the ambient environmentinformation may include information about the number of obstacles within100 m from the vehicle 100, the distances to the obstacles, the sizes ofthe obstacles, the sizes of the obstacles, and the like.

In addition, the sensing unit 160 may further include an accelerationpedal sensor, a pressure sensor, an engine speed sensor, an Air FlowSensor (AFS), an Air Temperature Sensor (ATS), a Water TemperatureSensor (WTS), a Throttle Position Sensor (TPS), a Top Dead Center (TDC)sensor, a Crank Angle Sensor (CAS), and the like.

The sensing unit 160 may include a biometric sensing unit. The biometricsensing unit senses and acquires biometric information about apassenger. The biometric information may include finger printinformation, iris scan information, retina scan information, handgeometry information, facial recognition information, and voicerecognition information. The biometric sensing unit may include a sensorfor sensing biometric information about a passenger. Herein, the camera122 and the microphone 123 may operate as sensors. The biometric sensingunit may acquire hand geometry information and facial recognitioninformation through the camera 122.

The sensing unit 160 may include at least one camera 161 for capturingthe outside of the vehicle 100. The at least one camera 161 may bereferred to as an ‘external camera’. For example, the sensing unit 160may include a plurality of cameras 161 disposed at different positionson the exterior of the vehicle 100. Each camera 161 may include an imagesensor and an image processing module. The camera 161 may process astill image or a video acquired through the image sensor (for example, aCharged Coupled Device (CCD) or Complementary Metal Oxide Semiconductor(CMOS) image sensor). The image processing module may extract necessaryinformation by processing the still image or video acquired through theimage sensor and provide the extracted information to the controller170.

The camera 161 may include an image sensor (for example, a CMOS or CCDimage sensor) and an image processing module. The camera 161 may alsoprocess a still image or a video acquired through the image sensor. Theimage processing module may process the still image or video acquiredthrough the image sensor. The camera 161 may also acquire an imageincluding at least one of a signal light, a traffic sign, a pedestrian,another vehicle, and a road surface.

The output unit 140 is configured to output information processed by thecontroller 170. The output unit 140 may include a display unit 141, anaudio output unit 142, and a haptic output unit 143.

The display unit 141 may include at least one display and displayinformation processed by the controller 170 on each display. Forexample, the display unit 141 may display vehicle-related information.The vehicle-related information may include vehicle control informationfor direct control of the vehicle or vehicle driving assist informationfor guiding driving of the driver. Also, the vehicle-related informationmay include vehicle state information indicting the current state of thevehicle or vehicle traveling information related to traveling of thevehicle.

The display unit 141 may include at least one of a Liquid CrystalDisplay (LCD), a Thin Film Transistor-Liquid Crystal Display (TFT LCD),an Organic Light Emitting Diode (OLED), a flexible display, a 3Ddisplay, and an e-ink display.

The display unit 141 may include at least one display. If the displayunit 141 includes a plurality of displays, each display may include atouch screen which forms a mutual layer structure with a touch sensor oris integrated with the touch sensor. Each display may be disposed at adifferent position inside the vehicle 100. For example, one display maybe disposed on a passenger seat side of a dashboard of the vehicle 100,and another display may be disposed on the rear surface of the head restof the driver's seat. In an embodiment, the display unit 141 may includea later-described display 200.

The touch screen may serve as an output interface between the vehicle100 and a user as well as the user input unit 124 that provides an inputinterface between the vehicle 100 and the user.

In this instance, the display unit 141 may include a touch sensor forsensing a touch on the display unit 141 in order to receive a controlcommand in a touch manner. Thus, when the display unit 141 is touched,the touch sensor may sense the touch, and thus the controller 170 cangenerate a control command corresponding to the touch. Content input bya touch may be a character, a number, or an indication or selectablemenu item in various modes.

In addition, the display unit 141 may include a cluster so that thedriver may check vehicle state information or vehicle travelinginformation, while driving the vehicle 100. The cluster may bepositioned on the dashboard. In this instance, the driver may viewinformation displayed on the cluster, while gazing ahead of the vehicle100.

According to an embodiment, the display unit 141 may include a Head UpDisplay (HUD). The HUD may include a projection module and thus outputdisplay light corresponding to predetermined information toward awindshield under the control of the controller 170. Accordingly, a usermay view a virtual image corresponding to the predetermined informationon the windshield.

The audio output unit 142 converts an electrical signal received fromthe controller 170 to an audio signal. For this purpose, the audiooutput unit 142 may include a speaker. The audio output unit 142 mayoutput a sound corresponding to an operation of the user input unit 124.

The haptic output unit 143 generates a haptic output. For example, thehaptic output unit 143 may vibrate the steering wheel, a safety belt, ora seat so that the user may recognize an output.

The vehicle driving unit 150 may control an operation of various devicesof the vehicle 100. The vehicle driving unit 150 may include at leastone of a power source driver 151, a steering driver 152, a brake driver153, a lamp driver 154, a Heating, Ventilating, and Air Conditioning(HVAC) driver 155, a window driver 156, an airbag driver 157, a sunroofdriver 158, and a wiper driver 159.

The power source driver 151 may perform electronic control on a powersource in the vehicle 100. The power source driver 151 may include anaccelerator for increasing the speed of the vehicle 100, and adecelerator for decreasing the speed of the vehicle 100.

For example, if a fossil fuel-based engine is a power source, the powersource driver 151 may perform electronic control on the engine.Therefore, the power source driver 151 may control the output torque ofthe engine. If the power source driver 151 is an engine, the powersource driver 151 may restrict the speed of the vehicle by limiting theengine output torque under the control of the controller 170.

In another example, if an electrical motor is a power source, the powersource driver 151 may control the motor. Thus, the rotation speed andtorque of the motor may be controlled.

The steering driver 152 may include a steering device. Thus, thesteering driver 152 may perform electronic control on the steeringdevice in the vehicle 100. For example, the steering driver 152 mayinclude a steering torque sensor, a steering angle sensor, and asteering motor, and a steering torque applied to the steering wheel bythe driver may be sensed by the steering torque sensor. The steeringdriver 152 may control a steering force and a steering angle by changingthe intensity and direction of current applied to the steering motorbased on the speed and steering torque of the vehicle 100.

Also, the steering driver 152 may determine whether the travelingdirection of the vehicle is properly controlled based on informationabout the steering angle acquired through the steering angle sensor.Thus, the steering driver 152 may change the traveling direction of thevehicle 100. Further, the steering driver 152 may increase a feeling ofweight for the steering wheel by increasing the steering force of thesteering motor during slow traveling of the vehicle 100, and decrease afeeling of weight for the steering wheel by decreasing the steeringforce of the steering motor during fast traveling of the vehicle 100.

If an autonomous driving function of the vehicle 100 is executed, thesteering driver 152 may control the steering motor to exert anappropriate steering force based on a sensing signal received from thesensor 160 or a control signal received from the controller 170, eventhough the driver manipulates the steering wheel (for example, in asituation where a steering torque is not sensed).

The brake driver 153 may perform electronic control on a brake device inthe vehicle 100. For example, the brake driver 153 may decrease thespeed of the vehicle 100 by controlling an operation of a brake disposedat a tire. In another example, the traveling direction of the vehicle100 may be adjusted to the left or right by differentiating operationsof brakes disposed respectively at left and right tires.

The lamp driver 154 may control turn-on/turn-off of at least one lampinside or outside the vehicle 100. Also, the lamp driver 154 may includea lighting device. Also, the lamp driver 154 may control the intensity,direction, and the like of light from a lamp. For example, the lampdriver 154 may control a turn signal lamp, a head lamp, a brake lamp,and the like.

The HVAC driver 155 may perform electronic control on a HVAC unit in thevehicle 100. For example, if a vehicle internal temperature is high, theHVAC unit may be controlled to operate and supply cool air into thevehicle 100.

The window driver 156 may perform electronic control on a window devicein the vehicle 100. For example, opening and closing of left and rightside windows of the vehicle 100 may be controlled.

The airbag driver 157 may perform electronic control on an airbag devicein the vehicle 100. For example, the airbag driver 157 may controlinflation of an airbag in an emergency situation.

The sunroof driver 158 may perform electronic control on a sunroofdevice in the vehicle 100. For example, the sunroof driver 158 maycontrol opening or closing of the sunroof.

The wiper driver 159 may perform electronic control on wipers 14 a and14 b provided in the vehicle 100. For example, upon receipt of a userinput commanding operation of the wipers 14 a and 14 b through the userinput unit 124, the wiper driver 159 may electronically control thenumber and speed of wipes according to the user input. In anotherexample, the wiper driver 159 may automatically drive the wipers 14 aand 14 b without receiving a user input by determining the amount orintensity of rain based on a sensing signal of a rain sensor included inthe sensing unit 160.

In addition, the vehicle driving unit 150 may further include asuspension driver. The suspension driver may perform electronic controlon a suspension device in the vehicle 100. For example, if the surfaceof a road is rugged, the suspension driver may control the suspensiondevice to reduce jerk of the vehicle 100.

The memory 130 is electrically connected to the controller 170. Thememory 130 may store basic data for a unit, control data for controllingan operation of the unit, and input and output data. The memory 130 maybe any of various storage devices in hardware, such as Read Only Memory(ROM), Random Access Memory (RAM), Erasable and Programmable ROM(EPROM), flash drive, hard drive, etc. The memory 130 may store variousdata for overall operations of the vehicle 100, such as programs forprocessing or controlling in the controller 170.

The interface unit 180 may serve as paths to various types of externaldevices connected to the vehicle 100. For example, the interface unit180 may include a port connectable to a portable terminal. The interfaceunit 180 may be connected to the portable terminal through the port. Inthis instance, the interface unit 180 may exchange data with theportable terminal.

In addition, the interface unit 180 may receive turn signal information.The turn signal information may be a turn-on signal for a turn signallamp for left turn or right turn, input by the user. Upon receipt of aturn-on input for a left or right turn signal lamp through the userinput unit (124 in FIG. 1) of the vehicle 100, the interface unit 180may receive left or right turn signal information.

The interface unit 180 may receive vehicle speed information,information about a rotation speed of the steering wheel, or gear shiftinformation. The interface unit 180 may receive the vehicle speedinformation, the information about a rotation speed of the steeringwheel, or the gear shift information, which is sensed through thesensing unit 160 of the vehicle 100. Or the interface unit 180 mayreceive the vehicle speed information, the information about a rotationspeed of the steering wheel, or the gear shift information from thecontroller 170 of the vehicle 100. The gear shift information may beinformation indicating a state in which a shift lever of the vehicle 100is placed. For example, the gear shift information may be informationindicating a state in which the shift lever is placed among P, R, N, D,and first-stage to multi-stage gear states.

The interface unit 180 may receive a user input through the user inputunit 124 of the vehicle 100. The interface unit 180 may receive the userinput directly from the input unit 124 of the vehicle 100 or through thecontroller 170.

The interface unit 180 may receive information acquired from an externaldevice. For example, when traffic light change information is receivedfrom an external server through the communication unit 110 of thevehicle 100, the interface unit 180 may receive the traffic light changeinformation from the controller 170.

The controller 170 can provide overall control to each unit inside thevehicle 100. The controller 170 can be referred to as an ElectronicControl Unit (ECU).

The controller 170 can be implemented in hardware using at least one ofan Application Specific Integrated Circuit (ASIC), a Digital SignalProcessor (DSP), a Digital Signal Processing Device (DSPD), aProgrammable Logic Device (PLD), a Field Programmable Gate Array (FPGA),a processor, a controller, a micro-controller, a microprocessor, and anelectrical unit for executing other functions.

The power supply 190 may supply power needed for operating eachcomponent under the control of the controller 170. Particularly, thepower supply 190 may receive power from a battery within the vehicle100.

An Audio Video Navigation (AVN) device may exchange data with thecontroller 170. The controller 170 can receive navigation informationfrom the AVN device or a separate navigation device. The navigationinformation may include information about a destination that has beenset, information about a route to the destination, map informationrelated to vehicle traveling, or information about a current location ofthe vehicle.

In addition, a part of the components illustrated in FIG. 1 may not bemandatory for implementation of the vehicle 100. Accordingly, thevehicle 100 described in the present disclosure may include more orfewer components than the above enumerated ones.

FIG. 2 illustrates the exterior of the vehicle 100 according to anembodiment of the present invention. For the convenience of description,it is assumed that the vehicle 100 is a four-wheeled vehicle.

Referring to FIG. 2, the vehicle 100 includes tires 11 a to 11 d rotatedby a power source, a steering wheel 12 for controlling the travelingdirection of the vehicle 100, head lamps 13 a and 13 b, and the wipers14 a and 14 b.

According to an embodiment of the present invention, the controller 170of the vehicle 100 can generate an image of the surroundings of thevehicle 100, detect information from the generated image of thesurroundings, and output a control signal for execution of an operationrelated to the vehicle 100 to the driving unit 150 based on the detectedinformation. For example, the controller 170 can control the steeringdevice or the like by a control signal.

In addition, an overall height H refers to a length from a groundingsurface to a highest spot of the vehicle 100. The overall height H maybe changed within a predetermined range according to the weight orposition of a passenger or loaded goods. Also, a lowest spot of the bodyof the vehicle 100 may be apart from a road surface by a groundclearance G. Accordingly, an object having a lower height than theground clearance G may be prevented from damaging the body of thevehicle 100.

It is assumed that the distance between the left and right front tires11 a and 11 b is equal to the distance between the left and right reartires 11 c and 11 d. Hereinbelow, it is assumed that the distance Tbetween the inner surfaces of the left and right front tires 11 a and 11b is equal to the distance T between the inner surfaces of the left andright rear tires 11 c and 11 d.

As illustrated, an overall width O of the vehicle 100 may be defined asa maximum distance between the leftmost and right most ends of the bodyof the vehicle 100 except for side mirrors (for example, folding powerside mirrors).

Next, FIG. 3A illustrates an example in which the camera 161 describedbefore with reference to FIG. 1 is a stereo camera. Referring to FIG.3A, the camera 161 may include a first camera 310 with a first lens 311and a second camera 320 with a second lens 321. As the first and secondlenses 311 and 312 are apart from each other by a predetermineddistance, two different images of the same object may be acquired at aspecific time point.

Also, the camera 161 may include a first light shield 312 and a secondlight shield 322 to shield light incident on the first lens 311 and thesecond lens 321. The camera 161 may be configured to be detachablyattached to a ceiling or a windshield inside the vehicle 100.

The camera 161 may acquire stereo images of a view ahead of the vehicle100. Disparity may be detected based on the stereo images, and at leastone object (for example, a pedestrian, a traffic light, a road, a lane,or another vehicle) appearing in at least one stereo image may bedetected based on disparity information. After an object is detected,movement of the object may be continuously tracked.

Referring to FIGS. 3B and 3C, four cameras 161 a, 161 b, 161 c, and 161d may be installed at different positions on the exterior of the vehicle100. Each of the four cameras 161 a, 161 b, 161 c, and 161 d isidentical to the afore-described camera 161.

Referring to FIG. 3B, the plurality of cameras 161 a, 161 b, 161 c, an161 d may be arranged at the front side, left side, right side, and rearside of the vehicle 100, respectively. Each of the cameras 161 a, 161 b,161 c, and 161 d may be included in the camera 161 illustrated in FIG.1.

The front camera 161 a may be disposed in the vicinity of thewindshield, an emblem, or a radiator grill. The left camera 161 b may bedisposed inside or outside a case surrounding a left side mirror. Or theleft camera 161 b may be disposed in an area of the exterior of a leftfront door, a left rear door, or a left fender.

The right camera 161 c may be disposed inside or outside a casesurrounding a right side mirror. Or the right camera 161 b may bedisposed in an area of the exterior of a right front door, a right reardoor, or a right fender. The rear camera 161 d may be disposed in thevicinity of a back number plate or a trunk switch.

Each image captured by the plurality of cameras 161 a, 161 b, 161 c, and161 d may be provided to the controller 170, and the controller 170 cangenerate an image of the surroundings of the vehicle 100 by synthesizingthe images.

While FIG. 3B illustrates attachment of four cameras onto the exteriorof the vehicle 100, the present invention is not limited to the numberof cameras. Thus, more or fewer cameras may be installed at differentpositions from the positions illustrated in FIG. 3B.

Referring to FIG. 3C, a synthetic image 400 may include a first imagearea 401 corresponding to an outside image captured by the front camera161 a, a second image area 402 corresponding to an outside imagecaptured by the left camera 161 b, a third image area 403 correspondingto an outside image captured by the right camera 161 c, and a fourthimage area 404 corresponding to an outside image captured by the rearcamera 161 d. The synthetic image 400 may be called an Around ViewMonitoring (AVM) image.

In addition, when the synthetic image 400 is generated, each ofboundaries 411, 412, 413, and 414 is generated between every pair ofoutside images included in the synthetic image 400. These boundary partsmay be naturally represented by image blending.

The boundaries 411, 412, 413, and 414 may be drawn between a pluralityof images. Also, a predetermined image representing the vehicle 100 maybe included at the center of the synthetic image 400. The syntheticimage 400 may be displayed on a display installed inside the vehicle100.

FIG. 4 illustrates an example of the vehicle 100 described before withreference to FIG. 1. Again, for the convenience of description, thevehicle 100 is assumed to be a four-wheeled vehicle.

Referring to FIGS. 1 and 4, the vehicle 400 may include at least oneradar 162, at least one LiDAR 163, and at least one ultrasonic sensor164. The radar 162 may be installed at a portion of the vehicle 100,radiate electromagnetic waves around the vehicle 100, and receiveelectronic waves reflected from various objects around the vehicle 100.

For example, the radar 162 may acquire information about a distance toan object, the heading of the object, the altitude of the object, andthe like by measuring a time taken for electronic waves to be reflectedand returned from the object.

The LiDAR 163 may be installed at a portion of the vehicle 100 andproject a laser beam around the vehicle 100. The laser beam projectedfrom the LiDAR 163 may be scattered or reflected and returned. The LiDAR163 may acquire information about physical properties of a target aroundthe vehicle 100, such as a distance to the target, the speed of thetarget, or the shape of the target based on a time of return, intensity,frequency change, and polarization change of the laser beam.

The ultrasonic sensor 164 may be installed at a portion of the vehicle100 and generates ultrasonic waves around the vehicle 100. Theultrasonic waves generated by the ultrasonic sensor 164 arecharacterized by a high frequency (about 20 KHz or higher) and a shortwavelength. The ultrasonic sensor 164 may be used mainly to recognize anobstacle or the like in the vicinity of the vehicle 100.

The at least one radar 162, the at least one LiDAR 163, and the at leastone ultrasonic wave sensor 164 illustrated in FIG. 4 may be sensorsincluded in the sensing unit 160 illustrated in FIG. 1. Also, it isobvious to those skilled in the art that different numbers of radars162, LiDARs 163, and ultrasonic sensors 164 from those illustrated inFIG. 4 may be installed at different positions from those illustrated inFIG. 4 according to an embodiment.

Next, FIG. 5 is an interior block diagram of the controller 170illustrated in FIG. 1. Referring to FIG. 5, the controller 170 includesan image pre-processor 510, a disparity calculator 520, a segmenter 532,an object detector 534, an object verifier 536, an object tracker 540,and an application unit 550.

The image pre-processor 510 can receive images from the cameras 161 and122 illustrated in FIG. 1 and pre-process the received images.Specifically, the image pre-processor 510 can subject an image to noisereduction, rectification, calibration, color enhancement, Color SpaceConversion (CSC), interpolation, camera gain control, and the like. As aconsequence, clearer images than stereo images captured by the cameras161 and 122 may be acquired.

The disparity calculator 520 can receive the signal-processed imagesfrom the pre-processor 510, performs stereo matching on the receivedimages, and acquire a disparity map according to the stereo matching.That is, the disparity calculator 520 can acquire disparity informationabout stereo images of a view ahead of the vehicle 100.

The stereo matching can be performed on the stereo images in units of apixel or a predetermined block. In addition, the disparity mapcorresponds to a map representing binocular parallax information ofstereo images, that is, left and right images as numerical values.

The segmenter 532 can segment and cluster at least one of the imagesbased on the disparity information received from the disparitycalculator 520. Specifically, the segmenter 532 can separate abackground from a foreground in at least one of the stereo images basedon the disparity information.

For example, the segmenter 532 can determine an area having disparityinformation equal to or smaller than a predetermined value in thedisparity map to be the background and exclude the area. Therefore, theforeground can be separated relatively.

In another example, the segmenter 532 can determine an area havingdisparity information equal to or larger than a predetermined value inthe disparity map to be the foreground and extract the area. Therefore,the foreground can be separated.

Since a foreground and a background are separated from each other usingdisparity information extracted based on stereo images in the abovemanner, a signal processing speed, the amount of a processed signal, andthe like can be reduced during later object detection.

The object detector 534 can detect an object based on an image segmentreceived from the segmenter 532. That is, the object detector 534 candetect an object from at least one image based on the disparityinformation.

Specifically, the object detector 534 can detect an object from at leastone image. For example, the object detector 534 can detect an object inthe foreground separated by an image segment.

The object verifier 536 can classify the separated object and verify theobject. For this purpose, the object verifier 536 can use a neuralnetwork-based verification scheme, a Support Vector Machine (SVM)scheme, a Haar-like based AdaBoost verification scheme, a Histograms ofOriented Gradients (HOG) scheme, or the like.

In addition, the object verifier 536 can verify the object by comparingthe detected object with objects stored in the memory 130. For example,the object verifier 536 can verify adjacent vehicles, lanes, a roadsurface, a sign board, a dangerous region, a tunnel, and the like in thevicinity of the vehicle.

The object tracker 540 tracks the verified object. For example, theobject tracker 540 can verify an object in sequentially acquired images,calculate a motion or motion vector of the verified object, and trackmovement of the object based on the calculated motion or motion vector.Accordingly, the adjacent vehicles, lanes, the road surface, the signboard, the dangerous region, the tunnel, and the like in the vicinity ofthe vehicle may be tracked.

The application unit 550 can calculate a risk of the vehicle 100 basedon various objects around the vehicle, for example, other vehicles,lanes, a road surface, or a sign board. Further, the application unit550 can calculate a probability of rear-ending a preceding vehicle anddetermine whether the vehicle slips.

The application unit 550 can output a message or the like to provideinformation about the calculation and determination based on thecalculated risk and rear-end collision possibility, or the determinationmade as to whether the vehicle slips. Or the application unit 550 cangenerate, as vehicle control information, a control signal for posturecontrol or traveling control.

According to an embodiment, the controller 170 can include only a partof the image pre-processor 510, the disparity calculator 520, thesegmenter 532, the object detector 534, the object verifier 536, theobject tracker 540, and the application unit 550. For example, if thecameras 161 and 122 provide only a 2D image, the disparity calculator520 may not be included.

Next, FIGS. 6A and 6B are views referred to illustrating an operation ofthe controller 170 illustrated in FIG. 5. In particular, FIGS. 6A and 6Bare views referred to illustrating an operation of the controller 170illustrated in FIG. 5 based on stereo images acquired during first andsecond frame intervals.

Referring to FIG. 6A, if the camera 161 is a stereo camera, the camera161 acquires stereo images during the first frame interval. Thedisparity calculator 520 of the controller 170 receives signal-processedstereo images FR1 a and FR1 b from the image pre-processor 510 andacquires a disparity map 620 by performing stereo matching on the stereoimages FR1 a and FR1 b.

The disparity map 620 represents disparities between the stereo imagesFR1 a and FR1 b as levels. It may be determined that as a disparitylevel is higher, a distance to a vehicle is shorter, and as thedisparity level is lower, the distance to the vehicle is longer.

When the disparity map 620 is displayed, luminosity may be higher for ahigher disparity level and lower for a lower disparity level on thedisparity map 620. In FIG. 6A, first to fourth lanes 628 a, 628 b, 628c, and 628 d have their corresponding disparity levels, and aconstruction site 622, a first preceding vehicle 624, and a secondpreceding vehicle 626 have their corresponding disparity levels on thedisparity map 620, by way of example.

The segmenter 532, the object detector 534, and the object verifier 536perform segmentation, object detection, and object verification on atleast one of the stereo images FR1 a and FR1 b based on the disparitymap 620.

In FIG. 6A, object detection and object verification are performed onthe second stereo image FR1 b using the disparity map 620, by way ofexample. That is, first to fourth lanes 638 a, 638 b, 638 c, and 638 d,a construction site 632, a first preceding vehicle 634, and a secondpreceding vehicle 636 may be detected as objects and verified in animage 630.

Referring to FIG. 6B, the camera 161 acquires stereo images during thesecond frame interval. The disparity calculator 520 of the controller170 receives signal-processed stereo images FR2 a and FR2 b from theimage pre-processor 510, and acquires a disparity map 640 by performingstereo matching on the stereo images FR2 a and FR2 b.

In FIG. 6B, first to fourth lanes 648 a, 648 b, 648 c, and 648 d havetheir corresponding disparity levels, and a construction site 642, afirst preceding vehicle 644, and a second preceding vehicle 646 havetheir corresponding disparity levels on the disparity map 640, by way ofexample.

The segmenter 532, the object detector 534, and the object verifier 536perform segmentation, object detection, and object verification on atleast one of the stereo images FR2 a and FR2 b based on the disparitymap 640.

In FIG. 6B, object detection and object verification are performed onthe second stereo image FR2 b using the disparity map 640, by way ofexample. That is, first to fourth lanes 658 a, 658 b, 658 c, and 658 d,a construction site 652, a first preceding vehicle 654, and a secondpreceding vehicle 656 may be detected as objects and verified in animage 650.

In addition, the object tracker 540 may track a verified object bycomparing FIG. 6A with FIG. 6B. Specifically, the object tracker 540 maytrack movement of each object verified in FIGS. 6A and 6B or the likebased on a motion or motion vector of the object. Accordingly, lanes, aconstruction site, a first preceding vehicle, a second precedingvehicle, and the like around the vehicle may be tracked.

FIG. 7 illustrates an exemplary interior view of the vehicle 100according to an embodiment of the present invention. Referring to FIG.7, a Center Information Display (CID) 141 a and at least one display 200a to 200 i may be included inside the vehicle 100. The CID 141 a and theat least one display 200 a to 200 i may be included in the display unit141 illustrated in FIG. 1. For the convenience of description, it isassumed that the vehicle 100 has four seats and four doors. Hereinafter,each of the displays 200 a to 200 i will be referred to as a hiddendisplay.

For example, as illustrated in FIG. 7, the displays 200 a to 200 i mayinclude a first hidden display 200 a on a dashboard 10, second to fifthhidden displays 200 b to 200 e on the doors, sixth and seventh hiddendisplays 200 f and 200 g on the rear surfaces of the head rests of twofront seats, and eighth and ninth hidden displays 200 h and 200 i onboth B-pillars.

The controller 170 can be connected to the plurality of hidden displays200 a to 200 i arranged inside the vehicle 100. Also, the controller 170can control the hidden displays 200 a to 200 i at the same time orindividually. The hidden displays 200 a to 200 i can perform apredetermined operation according to a control signal received from thecontroller 170. That is, the controller 170 can control an operation ofeach hidden display.

For example, the controller 170 can turn on one of the hidden displays200 a to 200 i, while turning off the other hidden displays. In anotherexample, the controller 170 can control the hidden displays 200 a to 200i to display different information.

In addition, the input unit 120 including the internal camera 122 andthe microphone 123 may be disposed inside the vehicle 100. The inputunit 120 may include a plurality of physical buttons for on/off controlof each of the hidden displays 200 a to 200 i.

As described before, the internal camera 122 may be disposed at aportion (for example, at a top end of the windshield) inside the vehicle100. Further, the microphone 123 can receive a voice command from apassenger in the vehicle 100.

The controller 170 can determine the position of a user (that is, apassenger) based on images received from the internal camera 122.Obviously, if there are a plurality of persons in the vehicle 100, thecontroller 170 can individually determine the positions of the users.

Also, the controller 170 can identify a user appearing in imagesreceived from the internal camera 122, based on the images. That is, thecontroller 170 can determine who is a passenger in the vehicle 100 atpresent. For example, facial images of pre-registered users and personalinformation (for example, name, age, gender, height, phone number, andrelation with a driver) related to each of the facial images may bepre-stored in the memory 130, and the controller 170 can extract afacial part from the images. Then, the controller 170 can acquirepersonal information about the user in the vehicle 100 at present bycomparing the extracted facial part with the pre-stored facial images ofthe memory 130, and identify the user based on the acquired personalinformation.

Further, at least one weight sensor may be provided inside the vehicle100. For example, a weight sensor may be provided at each of the fourseats. Obviously, additional weight sensors may be disposed at otherpositions (for example, on a mat and in a trunk) inside the vehicle 100.

The controller 170 can display information corresponding to a weightmeasured by a weight sensor on at least one of the hidden displays 200 ato 200 i. For example, if a weight measured by a weight sensor exceeds apredetermined threshold, the controller 170 can display a predeterminedalarm message on a hidden display nearest to a seat equipped with theweight sensor.

Next, FIG. 8 illustrates a structure of a hidden display according to anembodiment of the present invention. For the convenience of description,the structure of a hidden display will be described with reference to aside sectional view of the first hidden display 200 a illustrated inFIG. 7, taken along line A-B.

Referring to FIG. 8, the first hidden display 200 a includes a touchscreen 210 and a cover 220. The touch screen 210 may include a displaypanel 212 and a touch panel 214. As illustrated in FIG. 8, the touchpanel 214 may be stacked on and combined with the display panel 212.

Also, the cover 220 may be placed on the top surface of the touch screen210, that is, on top of the touch panel 214. Unlike the structureillustrated in FIG. 8, tempered glass may be interposed between thetouch screen 210 and the cover 220, in order to protect the touch screen210 from an external impact.

The cover 220 has a predetermined light transmittance. For example, thelight transmittance of the cover 220 may range from 10% to 20%.Accordingly, information displayed on the touch screen 210 can beprovided to the user through the cover 220. Further, the cover 220 mayhave the same color as an interior part having the first hidden display200 a in the vehicle 100. For example, if the first hidden display 200 ais disposed on a part of the dashboard 10, the cover 220 may befabricated in the same color as the dashboard 10.

Therefore, when the first hidden display 200 a is turned off, that is,the display panel 212 is turned off, the user does not readily view thefirst hidden display 200 a. That is, when no information is output onthe first hidden display 200 a, the first hidden display 200 a is notnoticeable, which renders the interior of the vehicle 100 to berelatively simple.

If the touch screen 210 is a capacitive type, the cover 220 may beformed of a conductive material. If the cover 220 is formed of aconductive material, the touch screen 210 may sense a capacitance changecaused by a touch on the cover 220 made by the user's finger or thelike. It is apparent that if the touch screen 210 is a resistive type,the cover 220 may not be formed of a conductive material.

The cover 220 may include a base layer 221, a first coating layer 221 a,and a second coating layer 221 b. The base layer 221 may be formed of amaterial such as electroconductive plastic. Also, the base layer 221 maybe formed by calendaring. Calendaring is a process of molding a sheet byrolling thermoplastic resin between two heated rollers. The lighttransmittance and tensile strength of the base layer 221 may bedetermined by a surface condition (for example, temperature) of the twoheated rollers.

The first coating layer 221 a and the second coating layer 221 b may becombined with the top and bottom surfaces of the base layer 221,respectively, thereby protecting the base layer 221. The first coatinglayer 221 a and the second coating layer 221 b may be combined with thebase layer 221 by a Gravure coating process.

While FIG. 8 has been described above in the context of the first hiddendisplay 200 a illustrated in FIG. 7, it is clear to those skilled in theart that the other hidden displays may also be configured in the samestructure as the first hidden display 200 a. It is to be clearlyunderstood that the size and shape of one hidden display may bedifferent from the size and shape of another hidden display.

Next, FIG. 9 illustrates a User Interface (UI) 900 for receiving aturn-on command and a turn-off command for the plurality of hiddendisplays 200 a to 200 i illustrated in FIG. 7. In particular, FIG. 9illustrates when the UI 900 is displayed on the CID 141 a illustrated inFIG. 7. The CID 141 a may include a touch screen. However, this ispurely exemplary and thus, the UI 900 may be displayed on a displayincluded in the display unit 141, other than the CID 141 a.

Referring to FIG. 9, the UI 900 provides a plurality of selectablegraphic buttons 900 a to 900 i, for receiving an on/off command for eachof the hidden displays 200 a to 200 i arranged inside the vehicle 100.In particular, the graphic buttons 900 a to 900 i interwork with thehidden displays 200 a to 200 i which, in this sequential order,correspond to the graphic buttons 900 a to 900 i.

In this instance, the controller 170 can change the color of the graphicbuttons 900 a to 900 i according to the on/off states of the hiddendisplays 200 a to 200 i. For example, if some hidden displays 200 b, 200f, and 200 g are off at present, the graphic buttons 900 b, 900f, and900 g interworking with the hidden displays 200 b, 200 f, and 200 g canbe displayed in a first color (for example, red), and the remaininggraphic buttons 900 a, 900 c to 900 e, and 900 h to 900 i can bedisplayed in a second color (for example, blue). Therefore, the user canreadily recognize which hidden displays are currently on and off amongthe hidden displays 200 a to 200 i.

Also, upon receipt of touch inputs for the graphic buttons 900 a to 900i, the controller 170 can control the on/off of the hidden displayscorresponding to the touch inputs. For example, when the user touchesthe graphic button 900 a, the controller 170 can turn on the firsthidden display 200 a in response to the touch on the graphic button 900a. When the user touches the graphic button 900 a again, the controller170 can turn off the first hidden display 900 a in response to the touchon the graphic button 900 a.

Next, FIGS. 10A and 10B illustrate an operation for controlling theplurality of hidden displays 200 a to 200 i illustrated in FIG. 7 in thevehicle 100 according to an embodiment of the present invention. In theillustrated case of FIG. 10A, a driver U1 is sitting in the driver'sseat with no passenger in the passenger seat to the right of thedriver's seat.

Specifically, the controller 170 can determine the presence or absenceof a user in the vehicle 100 based on images received from the internalcamera 122. In the presence of a user in the vehicle 100, the controller170 can determine the position of the user. For example, the controller170 can determine a seat at which the specific user sits, from among aplurality of seats.

In addition, the controller 170 can control an operation of a specificdisplay corresponding to the position of the user among the hiddendisplays 200 a to 200 i. For example, if the user sits in the passengerseat, the controller 170 can automatically turn on the first hiddendisplay 200 a on the dashboard among the hidden displays 200 a to 200 i.

If there is no passenger in the passenger seat as illustrated in FIG.10A, the controller 170 can leave the first hidden display 200 a off.Compared to FIG. 10A, FIG. 10B illustrates when a user U2 sits in thepassenger seat in the vehicle 100.

Further, as discussed above, the controller 170 can determine that theuser U2 is sitting in the passenger seat of the vehicle 100 by comparingimages received from the internal camera 122, sequentially in time.

The controller 170 can automatically turn on the first hidden display200 a corresponding to the position of the user U2 in response to thesitting of the user U2 at the passenger seat of the vehicle 100. Also,the controller 170 can display a predetermined UI 1000 on the firsthidden display 200 a.

Also, the controller 170 can identify the user U2 by extracting a facialpart of the user U2 in an image and comparing the extracted facial partwith the facial images pre-stored in the memory 130. That is, thecontroller 170 can access the memory 130 and acquire personalinformation from the memory 130, based on images received from theinternal camera 122.

For example, if the name of the user U2 is ‘Jane’, the controller 170can display a message 1001 related to the user U2 (for example, “Hi,Jane”) on the first hidden display 200 a. Further, the controller 170can display menus corresponding to functions available from the vehicle100 on the first hidden display 200 a. For example, the controller 170can display, on the first hidden display 200 a, the UI 1000 including amultimedia control menu 1010, an HVAC control menu 1020, and anavigation control menu 1030.

The controller 170 can also play multimedia such as music, a movie, aradio program, or a Digital Multimedia Broadcast (DMB) program accordingto a user input for the multimedia control menu 1010. The controller 170can also control temperature, air volume, wind direction, aircirculation, and the like according to a user input for the HVAC controlmenu 1020. The controller 170 can also set a destination, change thescale of an electronic map, collect traffic information, switch between2D and 3D modes of the map, and the like according to a user input forthe navigation control menu 1030.

In addition, the controller 170 can determine the position of the userU2 using a weight sensor instead of the internal camera 122. Forexample, if a weight measured by a weight sensor provided at thepassenger seat is equal to or higher than a predetermined value (forexample, 30 Kg), the controller 170 can determine that the user U2 issitting in the passenger seat. In this instance, the first hiddendisplay 200 a may not display a message related to the user U2 such as“Hi, Jane”.

Next, FIGS. 11A and 11B illustrate an operation for controlling theplurality of hidden displays 200 a to 200 i illustrated in FIG. 7 in thevehicle 100 according to an embodiment of the present invention. Thecontroller 170 can control an operation of at least one of the hiddendisplays 200 a to 200 i based on a voice command received from apassenger in the vehicle 100.

FIG. 11A illustrates when the driver U1 requests the user U2 sitting inthe passenger seat to enter the address of a destination by voice 1110.The microphone 123 can convert the input voice 1110 to an electricalsignal and provide the electrical signal to the controller 170.

The controller 170 can then control an operation of a specific hiddendisplay corresponding to the voice 1110 among the hidden displays 200 ato 200 i based on the electrical signal received from the microphone123.

FIG. 11B illustrates an operation of the controller 170 in response tothe voice 1110. Referring to FIG. 11B, if the voice 1110 is a message“Jane, please input address of destination”, the controller 170determines the meaning of the contents of the voice 1110 by a voicerecognition scheme and controls an operation of a specific hiddendisplay according to the determined meaning. That is, the controller 170can turn on the first hidden display 200 a corresponding to the positionof the user U2 based on ‘Jane’ included in the voice 1110.

Also, the controller 170 can display an input window 1120 fordestination setting on the first hidden display 200 a based on ‘inputaddress of destination’ included in the voice 1110.

FIGS. 12A, 12B, and 12C illustrate various examples of informationdisplayed on a hidden display in the vehicle 100 according to anembodiment of the present invention. In particular, FIG. 12A illustratesa music play screen 1210 displayed on a hidden display 200. For example,if a ‘Music’ icon is touched in the multimedia play menu 1010illustrated in FIG. 10B, the controller 170 can display the music playscreen 1210 by reproducing a predetermined music file.

FIG. 12B illustrates a route guiding screen 1220 displayed on the hiddendisplay 200. For example, the controller 170 can display the routeguiding screen 1220 on the hidden display 200 in response to a userinput requesting route guidance.

FIG. 12C illustrates an example of various indicators 1231 to 1235 thatmay be displayed on the hidden display 200 in the vehicle 200. Thecontroller 170 can change the alarm indicators 1231 to 1235 displayed onthe hidden display 200 by traveling situation or by location.

For example, if there is a user not wearing a seat belt in the vehicle100, the controller 170 can display the alarm indicator 1231 requestingfastening of a seat belt on at least one of the hidden displays 200 a to200 i.

In another example, in the presence of a speed bump within apredetermined distance ahead of the vehicle 100, the controller 170 candisplay the alarm indicator 1232 indicating the presence of a speed bumpon at least one of the hidden displays 200 a to 200 i.

In yet another example, in the presence of a school zone on a route ofthe vehicle 100, the controller 170 can display the alarm indicator 1233indicating the presence of a school zone on at least one of the hiddendisplays 200 a to 200 i.

In still another example, in the presence of an intersection on theroute of the vehicle 100, the controller 170 can display the alarmindicator 1234 indicating the presence of an intersection on at leastone of the hidden displays 200 a to 200 i.

In another example, if a road on which the vehicle 100 is riding is aone-way road, the controller 170 can display the alarm indicator 1235indicating that the vehicle 100 is riding on a one-way road on at leastone of the hidden displays 200 a to 200 i. In this instance, thecontroller 170 can preliminarily determine whether there is a speedbump, a school zone, an intersection, or the like on the route of thevehicle 100 based on map information.

In addition, the controller 170 can control the screen brightness ofeach of at least one hidden display according to the type of informationdisplayed on the hidden display. In particular, in one embodiment, thecontroller 170 can display information related to passenger safety inthe vehicle 100 at a first brightness level and information not relatedto passenger safety at a second brightness level. For example, the alarmindicator 1231 illustrated in FIG. 12C can be displayed at the firstbrightness level, and the music play screen 1210 illustrated in FIG. 12Acan be displayed at the second brightness level.

In addition, the various types of information illustrated in FIGS. 12A,12B, and 12C can be displayed on different hidden displays. That is, thecontroller 170 can display information different from informationdisplayed on one hidden display on another hidden display. For example,the music play screen 1210 illustrated in FIG. 12A can be displayed onthe sixth hidden display 200 f, whereas the route guiding screen 1220illustrated in FIG. 12B can be displayed on the seventh hidden display200 g.

Next, FIGS. 13A and 13B illustrate control of an operation of a hiddendisplay provided on a door in the vehicle 100 according to an embodimentof the present invention. The control will be described in the contextof the fifth hidden display 200 e illustrated in FIG. 7.

In particular, FIG. 13A illustrates a touch input 1310 that a user U3applies to the fifth hidden display 200 e. If the touch input 1310 tothe fifth hidden display 200 e matches a predetermined pattern, with noinformation displayed on the fifth hidden display 200 e, the controller170 can turn on the fifth hidden display 200 e. Further, if a touchinput that does not match the predetermined pattern is received, thecontroller 170 can leave the fifth hidden display 200 e off.

For example, the predetermined pattern may be pressing a point in apredetermined area of the fifth hidden display 200 e with pressure equalto or stronger than a threshold value. In another example, thepredetermined pattern may be connecting two different pointssequentially on the fifth hidden display 200 e. In another example, thepredetermined pattern may be touching at least one point on the fifthhidden display 200 e a plurality of times within a predetermined timelimit. It is obvious that many other patterns are also available.

FIG. 13B illustrates information displayed on the fifth hidden display200 e. Specifically, if the touch input of FIG. 13A matches thepredetermined pattern, the controller 170 can display a menucorresponding to a function pre-associated with the fifth hidden display200 e, simultaneously with turning on the fifth hidden display 200 e.

Different functions may be associated with the plurality of hiddendisplays 200 a to 200 i, and data of the function related to each hiddendisplay may be pre-stored in the memory 130. The controller 170 canacquire data of a function associated with a specific hidden displayfrom the memory 130 and display specific information on the specifichidden display based on the acquired data.

For example, the fifth hidden display 200 e is disposed on a door of thevehicle 100 and a door locking/unlocking function and a windowopening/closing function may be pre-associated with the fifth hiddendisplay 200 e. In this instance, the controller 170 can display a menu1311 for selection of door locking or unlocking and a menu 1312 forcontrolling an opening/closing degree of a window on the fifth hiddendisplay 200 e.

FIGS. 14A, 14B, and 14C illustrate control of an operation of a hiddendisplay provided on a door in the vehicle 100 according to an embodimentof the present invention. The control will be described in the contextof the fifth hidden display 200 e illustrated in FIG. 7.

FIG. 14A illustrates an example in which the user U3 sitting in theright back seat utters voice 1410, with the fifth hidden display 200 eoff in the vehicle 100. The voice 1410 of the user U3 may be received atthe microphone 123, and the controller 170 can receive an electricalsignal corresponding to the voice 1410 of the user U3 from themicrophone 123.

Also, the controller 170 can control an operation of a specific hiddendisplay corresponding to the voice 1410 among the plurality of hiddendisplays 200 a to 200 i by the voice recognition scheme. In addition,information about at least one hidden display corresponding to each of aplurality of predetermined positions may be pre-stored in the memory130.

In this instance, two or more hidden displays may correspond to aspecific position, and two or more positions may correspond to aspecific hidden display. For example, information about three hiddendisplays 200 e, 200 g, and 200 i corresponding to the position of theright back seat may be pre-stored in the memory 130. If determining thatthe user U3 is sitting in the right back seat by means of the internalcamera 122, the controller 170 can set the hidden displays 200 e, 200 g,and 200 i as control candidates.

FIG. 14B illustrates an example in which the controller 170 controls thespecific fifth hidden display 200 e among the three hidden displays 200e, 200 g, and 200 i set as control candidates in response to the voice1410 of the user U3.

Specifically, the controller 170 can select the fifth hidden display 200e from among the three hidden displays 200 e, 200 g, and 200 i byrecognizing ‘window’ in the voice 1410 according to the voicerecognition scheme. For example, a window control screen 1400 mayinclude a window roll-up button 1421, a window roll-down button 1422,and an indicator 1423 indicating a current opening degree of a window.In this instance, if the window is fully open, the indicator 1423 mayindicate 0%, and if the window is completely closed, the indicator 1423may indicate 100%.

Also, if the user U3 touches the window roll-up button 1421, thecontroller 170 can roll up the window. If the user U3 touches the windowroll-down button 1422, the controller 170 can roll down the window. Inaddition, if the user U3 touches the menu 1312 illustrated in FIG. 13B,the window control screen 1400 illustrated in FIG. 14B may be displayed.

FIG. 14C illustrates weather notification screen 1430 displayed on thefifth hidden display 200 e, when the user U3 touches the windowroll-down button 1422 with the window completely closed as illustratedin FIG. 14B.

Specifically, the controller 170 can receive weather information for acurrent location of the vehicle 100 from an external server through thecommunication unit 110. For example, the wireless Internet module 112 ofthe communication unit 110 may receive the weather information from theexternal server.

If the received weather information indicates bad weather, thecontroller 170 can display the weather notification screen 1430 on thefifth hidden display 200 e before rolling down the window in response tothe touch on the window roll-down button 1422.

In addition, reference data may be pre-stored in the memory 130 so thatit may be determined whether a current weather is bad weather based onthe reference data. For example, if the current weather informationindicates a rainfall of 30 mm/h, the controller 170 can determine badweather. Besides, weather information about snow, hail, fine dust,yellow dust, ozone, or the like may be provided to the user U3 throughthe weather notification screen 1430.

As illustrated in FIG. 14C, a message recommending caution about badweather outside the vehicle 100 may be displayed on the weathernotification screen 1430. If the user U3 touches a button 1431 on theweather notification screen 1430, the controller 170 can roll down thewindow.

Next, FIGS. 15A and 15B illustrate control of a hidden display providedon a door in the vehicle 100 according to an embodiment of the presentinvention. In particular, FIG. 15A illustrates an example in which thewindow has been rolled down in response to the touch of the user U3 onthe window roll-down button 1422 as illustrated in FIG. 14B.

The controller 170 can determine how much to roll down the window basedon at least one of a touch time and the number of touches on the windowroll-down button 1422. For example, each time the window roll-downbutton 1422 is touched once, the controller 170 can roll down the windowby 1 cm. In another example, if the touch on the window roll-down button1422 is kept for a predetermined time or longer (for example, 3 secondsor longer), the controller 170 can roll down the window completely.

Also, the controller 170 can change the indicator 1423 according to anopening degree of the window. For example, if the window has been rolleddown by ¼ in a complete closed state in response to the touch on thewindow roll-down button 1422, the indicator 1423 may indicate from 100%to 75%.

FIG. 15B illustrates an example in which the controller 170 executes anautomatic turn-off function for the fifth hidden display 200 e. If atouch input has not been received for a predetermined time or longerwith a specific hidden display on, the controller 170 can automaticallyturn off the specific hidden display. For example, if no touch input hasbeen received from the user U3 for 10 seconds or longer from a time whenthe window control screen 1400 is initially displayed on the fifthhidden display 200 e as illustrated in FIG. 15A, the controller 170 canautomatically turn off the fifth hidden display 200 e.

Obviously, even though a predetermined time has not elapsed, thecontroller 170 can turn off the fifth hidden display 200 e according toa predetermined user input. For example, the controller 170 can turn offthe fifth hidden display 200 e in response to a voice command ‘Turn offthe screen’. In another example, the input unit 120 may include physicalbuttons for turning on and off each of the hidden displays 200 a to 200i. When a user presses one of the physical buttons, the controller 170can turn off a specific hidden display corresponding to the pressedbutton.

FIGS. 16A and 16B illustrate control of an operation of a hidden displayprovided on a door in the vehicle 100 according to an embodiment of thepresent invention. In particular, FIG. 16A illustrates an example inwhich a door control screen 1600 is displayed on the fifth hiddendisplay 200 e. For example, when the user U3 touches the menu 1311illustrated in FIG. 13B, the door control screen 1600 may be displayedon the fifth hidden display 200 e as illustrated in FIG. 16A.

In addition, the door control screen 1600 may include buttons selectablefor locking and unlocking a door. For example, as illustrated in FIG.16A, the door control screen 1600 may include a door lock button 1611and a door unlock button 1612. Further, the door control screen 1600 mayinclude an indicator 1613 indicating the locked or unlocked state of thedoor. For example, the indicator 1613 may be an icon indicating that thedoor is currently unlocked.

If the user U3 touches the door lock button 1611 with the door unlocked,the controller 170 can lock the door. In this instance, the indicator1613 may be changed to an icon indicating that the door is currentlylocked. When the user U3 touches the door unlock button 1612 with thedoor locked, the controller 170 can unlock the door.

FIG. 16B illustrates an example in which the locked state of the door ischanged according to a touch of the user U3, with a screen of the fifthhidden display 200 e off. In the present invention, turn-off of a hiddendisplay may mean that only the display panel 212 of the hidden displayis turned off. In this instance, the touch panel 214 may be kept on sothat a touch input of the user may be sensed.

As illustrated, if a touch input of the user U3 to the fifth hiddendisplay 200 e is a drag input moved from left to right for apredetermined distance, the controller 170 can unlock the door. Further,if a touch input of the user U3 to the fifth hidden display 200 e is adrag input moved from right to left for a predetermined distance, thecontroller 170 can lock the door.

While it has been described with reference to FIG. 16B that a door islocked and unlocked according to a left to right drag input with thescreen of the fifth hidden display 200 e off, the present invention isnot limited thereto. For example, if the user applies an upward draginput for a predetermined distance or farther, the controller 170 canperform a window roll-up operation. If the user applies a downward draginput for a predetermined distance or farther, the controller 170 canperform a window roll-down operation.

While FIGS. 16A and 16B have been described in the context of the fifthhidden display 200 e, it is obvious to those skilled in the art thatother hidden displays may be controlled in the same manner.

FIGS. 17A and 17B illustrate an operation for displaying differentinformation on a hidden display according to an identified user in thevehicle 100 according to an embodiment of the present invention.

FIG. 17A illustrates when a user U4 is sitting in the left back seat inthe vehicle 100. The controller 170 can determine that the user U4 issitting in the left back seat of the vehicle 100 using the internalcamera 122 or a weight sensor. Accordingly, the controller 170 canautomatically turn on the sixth hidden display 200 f.

Also, the controller 170 can identify the user U4 based on imagesreceived from the internal camera 122. For example, the controller 170can acquire age information about the user U4 by comparing a facial partof the user U4 appearing in an image received from the internal camera122 with the facial images pre-stored in the memory 130.

If there is no facial image matching the face of the user U4 in thememory 130, the controller 170 can estimate the age of the user U4 basedon a face and body size in an image. Or the controller 170 can estimatethe age of the user U4 based on a weight measured by the weight sensor.For example, if the weight measured by the weight sensor is less than apredetermined threshold (for example, 20 Kg), it may be determined thatthe user U4 is a baby.

If determining that the user U4 is a baby, the controller 170 candisplay content 1710 configured for babies among a plurality of contentsstored in the memory 130 on the sixth hidden display 200 f. For example,the content 1710 for babies displayed on the sixth hidden display 200 fmay be a movie for babies.

Also, the controller 170 can display safety-related information alongwith the content 1710 for babies on the sixth hidden display 200 f. Forexample, if the user U4 does not wear a seat belt, the controller 170can display a message 1711 requesting fastening of a seat beltoverlapped with the content 1710 for babies.

Compared to FIG. 17A, FIG. 17B illustrates an example that a user USsitting in the left back seat is an adult. The controller 170 canacquire identification information about the user U5 based on at leastone of an image received from the internal camera 122 and a weightmeasured by the weight sensor. Also, if the controller 170 determinesthat the user U5 is an adult based on an age indicated by theidentification information about the user U5, the controller 170 candisplay a UI 1720 on the sixth hidden display 200 f.

If the name of the user U5 is ‘Chris’, the controller 170 can display amessage 1721 related to the user U5 (for example, “Hi, Chris”)overlapped with the UI 1720.

Next, FIGS. 18A and 18B illustrate an operation for displaying a screenof a mobile device located inside the vehicle on a hidden displayaccording to an embodiment of the present invention. In particular, FIG.18A illustrates an example in which a screen of a mobile device 1800 ofthe user U5 is shared on the sixth hidden display 200 f corresponding tothe position of the user U5. That is, the controller 170 can mirror animage displayed on the screen of the mobile device 1800 onto a screen ofthe sixth hidden display 200 f. Therefore, the user U5 can view the sameimage on the different devices 200 f and 1800.

The mobile device 1800 may be any of portable electronic devicesincluding, for example, a portable phone, a smart phone, a laptopcomputer, a digital broadcasting terminal, a Personal Digital Assistant(PDA), a Portable Multimedia Player (PMP), a tablet PC, an ultrabook,and a wearable device.

The communication unit 110 may exchange data with the mobile device 1800by establishing a wired/wireless connection with the mobile device 1800.For example, the short-range communication module 113 of thecommunication unit 110 may be paired with the mobile device 1800 insidethe vehicle 100 and receive an image displayed on the screen of themobile device 1800. Further, the controller 170 can display an image1810 received from the mobile device 1800 on the specific hidden display200 f among the hidden displays 200 a to 200 i. The wirelesscommunication connection may be established between the short-rangecommunication module 113 and the mobile device 1800 in conformance to awireless communication protocol such as Wi-Fi, Wi-Fi Direct), infraredcommunication, Zigbee, NFC, RFID, Bluetooth, or UWB.

Or the communication unit 110 may display the image 1810 displayed onthe screen of the mobile device 1800 on the sixth hidden display 200 fcorresponding to the position of the user U5 through wired communicationsuch as USB or Mobile High-Definition Link (MHL).

The screen size of the sixth hidden display 200 f may be larger than thescreen size of the mobile device 1800. The controller 170 can enlargethe image displayed on the mobile device 1800 in correspondence with ascreen size ratio between the two devices 200 f and 1800 and thendisplay the enlarged image on the sixth hidden display 200 f.

FIG. 18B illustrates an example in which the size of the image 1810 ischanged in response to a user input for the image 1810 displayed on thesixth hidden display 200 f. For example, if the user U5 applies apinch-in gesture input to an area in which the image 1810 is displayed,the controller 170 can display an image 1811 smaller than the image 1810by a predetermined ratio on the sixth hidden display 200 f in responseto the pinch-in gesture input. While not shown, if the user U5 applies apinch-out gesture input to an area in which the image 1810 is displayed,the controller 170 can display an image larger than the image 1810 by apredetermined ratio on the sixth hidden display 200 f in response to thepinch-out gesture input.

FIG. 19 illustrates an operation for displaying an outside image of thevehicle 100 on a hidden display in the vehicle 100 according to anembodiment of the present invention. Referring to FIG. 19, thecontroller 170 can display an outside image 1910 on at least one hiddendisplay corresponding to the position of a user U6.

For example, if the user U6 is sitting in the right back seat of thevehicle 100 as illustrated in FIG. 19, the controller 170 can displaythe outside image 1910 on the ninth hidden display 200 i disposed on theright B-pillar. The outside image 1910 may be provided by the rightcamera 161 c illustrated in FIG. 3B.

That is, if the user U6 is sitting in the right back seat of the vehicle100, the controller 170 can display the outside image 1910 received fromthe right camera 161 c on the ninth hidden display 200 i. Further, ifthe user U6 is sitting in the left back seat, the controller 170 candisplay an outside image received from the left camera 161 b on theeighth hidden display 200 h.

In addition, the controller 170 can detect an object 1911 in the outsideimage 1910. Also, the controller 170 can calculate a collision riskindex between the object 1910 and the vehicle 100 based on at least oneof the type, size, speed, and direction of the object 1911 and thedistance between the object 1911 and the vehicle 100. If the calculatedcollision risk index exceeds a predetermined threshold, the controller170 can display an indicator 1912 indicating the risk of colliding withthe object 1911, overlapped over the outside image 1910.

Further, the controller 170 can display an AVM image 1913 at a part ofthe ninth hidden display 200 i. As described before with reference toFIG. 3C, the controller 170 can generate the AVM image 1913 in real timeor periodically by synthesizing images received from the externalcameras 161 a to 161 d, and display the AVM image 1913 in a Picture InPicture (PIP) manner.

In addition, the outside image 1910 may be displayed on the ninth hiddendisplay 200 i, only under a specific condition. For example, if the userU6 unlocks a door while the vehicle 100 is stationary, the controller170 can display the outside image 1910 on the ninth hidden display 200i. Accordingly, the user U6 may readily recognize the presence of theobject 1911 in the outside image 1910. Thus, when the object 1911 passesby, the user U6 may open the door and get off safely.

FIGS. 20A, 20B, and 20C illustrate an operation for displaying an alarmindicator on a hidden display in the vehicle 100 according to anembodiment of the present invention.

The controller 170 can display an alarm indicator corresponding to atleast one of the traveling situation and position of the vehicle 100 onat least one of the hidden displays 200 a to 200 i. Data of thetraveling situation of the vehicle may be provided by the sensing unit160 illustrated in FIG. 1. Information about the position of the vehicle100 may be provided by the location information module 114 of thecommunication unit 110.

FIG. 20A illustrates an example in which when the user U2 sitting in thepassenger seat selects a movie play button in the multimedia controlmenu 1010 as illustrated in FIG. 10B, a movie play screen 2010 triggeredby play of a specific movie is displayed on the first hidden display 200a. For example, if the vehicle 100 is parked or stopped or is movingbelow a predetermined speed (for example, 10 Km/h), even though the userU2 has not fastened a seat belt, the controller 170 can display no otherinformation than the movie play screen 2010 on the first hidden display200 a.

FIG. 20B illustrates an example in which an alarm indicator 2011corresponding to at least one of the traveling situation and position ofthe vehicle 100 on the first hidden display 200 a during play of amovie. For example, if the vehicle 100 is moving at or above apredetermined speed (for example, 10 Km/h) or enters an expressway, thecontroller 170 can display the alarm indicator 2011 encouragingfastening of a seat belt on the first hidden display 200 a.

In this instance, the controller 170 can display the alarm indicator2011 on the movie play screen 2010 in the PIP manner. That is, the alarmindicator 2011 may be displayed smaller than the movie play screen 2010.Further, the controller 170 can temporarily pause the movie play screen2010 and display an indicator 2012 indicating temporary pause of themovie play screen 2010 on the first hidden display 200 a.

FIG. 20C illustrates an exemplary change of information displayed on thefirst hidden display 200 a. Referring to FIG. 20C, if the user U2 doesnot respond to the indicator 2012, that is, if the user U2 does notfasten a seat belt until a predetermined time (for example 5 seconds)elapses after the initial appearance of the indicator 2011, thecontroller 170 can enlarge the indicator 2011, while contracting themovie play screen 2010. In this instance, the size of the enlargedindicator 2011 may be larger than the size of the contracted movie playscreen 2010.

If the user U2 fastens a seat belt in this state, the controller 170 canautomatically resume to play the movie, without displaying the indicator2012 any longer on the first hidden display 200 a.

FIGS. 21A and 21B illustrate an operation for displaying an alarmindicator on a hidden display in the vehicle 100 according to anembodiment of the present invention.

As described before, a weight sensor can be provided per seat in thevehicle 100. The controller 170 can measure the weight of each seatusing the weight sensors before and after a user gets on the vehicle100. If the difference between the weight measured before the user getson the vehicle 100 and the weight measured after the user gets on thevehicle 100 is equal to or larger than a predetermined threshold, thecontroller 170 can display, on a hidden display, an alarm messagetelling the user not to leave his or her belongings behind in thevehicle 100 before the user gets off the vehicle 100.

FIG. 21A illustrates an example in which a user U7 is sitting in theright back seat of the vehicle 100 and an object 2100 is placed on theleft back seat. In this instance, the user U7 can touch the door unlockbutton 1612 of the door control screen 1600 illustrated in FIG. 16A inorder to get off the vehicle 100.

FIG. 21 B illustrates an alarm message 2110 displayed on a specifichidden display 200 g, when the user U7 touches the door unlock button1612 of the door control screen 1600. For example, when the user U7 isto get off the vehicle 100, the controller 170 can determine whetherthere is the object 2100 on at least one of the seats of the vehicle 100based on a weight measured by a weight sensor.

If the controller 170 determines the presence of the object 2100 in thevehicle 100, the controller 170 can display an alarm message 2110 on theseventh hidden display 200 g corresponding to the position of the userU7. In this instance, the alarm message 2110 may include informationabout the position of the object 2100. Therefore, the user U7 isrelieved of inconvenience caused by loss of the object 2100 or retrievalof the object 2100.

In addition, while it has been described with reference to FIGS. 21A and21B that a plurality of weight sensors are provided for the seats of thevehicle 100, the present invention is not limited thereto. For example,one of the weight sensors may be disposed at the floor inside thevehicle 100 and another weight sensor may be disposed in the trunk, tothereby measure the weight of a passenger or a baggage.

FIG. 22 illustrates an operation for controlling the screen color ofeach of the hidden displays 200 a to 200 i according to a presetscenario in the vehicle 100 according to an embodiment of the presentinvention.

When the plurality of hidden displays 200 a to 200 i are disposed insidethe vehicle 100, the controller 170 can control the screen color of atleast one of the hidden displays 200 a to 200 i according to a presetscenario.

Data of a plurality of scenarios for controlling the screen colors ofthe hidden displays 200 a to 200 i may be pre-stored in the memory 130.The controller 170 can select a specific scenario corresponding to auser input or the traveling situation of the vehicle 100 and control thescreen color of each of the hidden displays 200 a to 200 i based on theselected specific scenario.

For example, a first scenario among the plurality of scenarios mayinclude control data with which the screens of the hidden displays 200 ato 200 i are displayed in a first color (for example, blue) at the sametime for a predetermined time. In another example, a second scenarioamong the plurality of scenarios may include control data with which thescreens of the hidden displays 200 a to 200 i flicker in a second color(for example, yellow) simultaneously at every predetermined interval. Inanother example, a third scenario among the plurality of scenarios mayinclude control data with which the screens of the hidden displays 200 ato 200 i are displayed in different colors.

FIG. 22 illustrates an example in which the screens of the hiddendisplays 200 a to 200 i are controlled to be displayed in the same firstcolor (for example, blue) according to the afore-mentioned firstscenario. In this instance, the controller 170 can display predeterminedcontent. (for example, a photo list) mapped to the first scenario on atleast one of the hidden displays 200 a to 200 i. According to FIG. 22, auser can create various interior atmospheres according to his or hermood or a traveling situation.

As is apparent from the foregoing description, the vehicle and themethod for controlling the vehicle according to an embodiment of thepresent invention have the following effects.

According to at least one of the embodiments of the present invention,since the vehicle includes at least one display equipped with a coverhaving a predetermined light transmittance, a sense of visual differencebetween the display and other interior parts can be reduced anddistraction of a user's vision can be suppressed.

According to at least one of the embodiments of the present invention,the use efficiency of a user can be increased by displaying differentinformation on each display according to the position of each user inthe vehicle, the traveling situation of the vehicle, a touch input, orthe like.

According to at least one of the embodiments of the present invention,information corresponding to inside and outside situations of thevehicle can be provided on a display.

The above-described embodiments of the present invention may beimplemented not only by an apparatus and a method but also by a programfor implementing functions corresponding to the configurations of theembodiments of the present invention or a recording medium recording theprogram. Those skilled in the art will readily realize theimplementation from the foregoing description of the embodiments of thepresent invention.

Because many replacements, variations, and modifications can be made tothe present invention without departing the scope and spirit of thepresent invention, the present invention is not limited by the foregoingembodiments and the attached drawings. Rather, many modifications can bemade by selectively combining the whole or a part of each embodiment.

What is claimed is:
 1. A vehicle comprising: a plurality of displaysdisposed at different positions inside the vehicle, each displayincluding a touch screen and a cover layer on a top surface of the touchscreen, the cover layer of a corresponding display having a colorcharacteristic based on an interior part of the vehicle having thedisplay such that when the corresponding display is off, thecorresponding display appears hidden; a sensor configured to detect aseat location of a person seated in the vehicle; and a controllerconfigured to: selectively control the plurality of the displays basedon the detect seat location of the person seated in the vehicle.
 2. Thevehicle according to claim 1, wherein a light transmittance of the coverlayer is equal to or larger than 10% and equal to or smaller than 20%.3. The vehicle according to claim 1, wherein the cover layer includes aconductive material.
 4. The vehicle according to claim 1, wherein theplurality of displays are disposed in a part of at least one of adashboard, doors, seats, and B-pillars of the vehicle.
 5. The vehicleaccording to claim 1, wherein the sensor includes an internal camera forcapturing the person in the vehicle, and wherein the controller isfurther configured to: detect the seat location of the person seated inthe vehicle based on an image received from the internal camera, andturn on a specific display corresponding to the detected seat locationof the person seated in the vehicle.
 6. The vehicle according to claim5, wherein the controller is further configured to: identify the personseated in the vehicle based on the image received from the internalcamera, and display information corresponding to the identification ofthe person on the specific display.
 7. The vehicle according to claim 1,further comprising: an input unit configured to receive a user input,wherein the controller is further configured to turn on and off aspecific display corresponding to the user input.
 8. The vehicleaccording to claim 7, wherein the input unit includes a microphoneconfigured to receive voice of a user, and wherein the controller isfurther configured to display information corresponding to the voice onthe specific display.
 9. The vehicle according to claim 1, wherein thecontroller is further configured to control a screen color of eachdisplay according to a preset scenario.
 10. The vehicle according toclaim 1, wherein the plurality of displays include a first displaydisposed at a first position and a second display disposed at a secondposition inside the vehicle, and wherein the controller is furtherconfigured to display first information on the first display and secondinformation different from the first information on the second display.11. The vehicle according to claim 1, wherein the controller is furtherconfigured to turn off a specific display that does not receive a touchinput for a predetermined time or longer from among the plurality ofdisplays.
 12. The vehicle according to claim 1, further comprising: anexternal camera configured to capture surroundings of the vehicle,wherein the controller is further configured to display an outside imagereceived from the external camera on at least one display of theplurality of displays.
 13. The vehicle according to claim 12, whereinthe controller is further configured to: detect an obstacle in theoutside image, and display information indicating a risk of collidingwith the obstacle along with the outside image on the at least onedisplay.
 14. The vehicle according to claim 1, wherein the controller isfurther configured to turn on a specific display receiving a touch inputof a predetermined pattern.
 15. The vehicle according to claim 1,wherein the controller is further configured to perform an operationcorresponding to a touch input sensed by a specific display among theplurality of displays.
 16. The vehicle according to claim 1, furthercomprising: a short-range communication module configured to wirelesscommunicate with a mobile device located inside the vehicle, wherein thecontroller is further configured to: receive an image displayed on themobile device through the short-range communication module, and displaythe received image on the corresponding display.
 17. The vehicleaccording to claim 1, further comprising: a wireless Internet moduleconfigured to receive weather information about a current location ofthe vehicle from an external server, wherein the controller is furtherconfigured to display the weather information on a specific displayamong the plurality of displays.
 18. The vehicle according to claim 1,wherein the controller is further configured to control a screenbrightness of each corresponding display according to a type ofinformation displayed on the corresponding display.
 19. The vehicleaccording to claim 1, wherein the controller is further configured todisplay an alarm indicator corresponding to at least one of a travelingsituation and a location of the vehicle on the corresponding display.20. The vehicle according to claim 1, wherein the sensor comprises atleast one weight sensor disposed inside the vehicle, and wherein thecontroller is further configured to display an alarm message indicatinga presence of an object placed inside the vehicle on a specific displayamong the plurality of displays, based on a weight measured by the atleast one weight sensor before the person gets out of the vehicle.